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Packet 
Type 


Full Name 


Address Space 


Description 


Cacheable 


I/O 


RTS 


ReadToShare 


Y 




Reouests read-onlv codv of cache linp 


RTO 


ReadToOwn 


Y 




Reouests writablp rnnv of rarhp finp 


RTWB 


ReadToWriteBack 


Y 




RSOUPSt^ to rPPPIVP wn'tahla rnnw nf oraches |; n n 

and send cache tine to memory 


RS 


ReadStream 


Y 




lACLjucoi icdu-uiioc (-upy or cacne line 


WS 


WriteStream 


Y ! 




request 10 wnte entire cacne line and send to 
memory 


WB 


WriteBack 


Y 




Request to send cache line from owning device 
to memory, device does not keep copy 


WBS 


WriteBackShared 


Y 




Request to send cache line from owning device 
to memory, device keeps read-only copy 


RIO 


Read 10 




Y 


Request to read 10 locations 


WIO 


WritelO 




Y 


Request to write 10 locations 


INT 


Interrupt 






Sends an interrupt, target is specified by 
address 
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Transaction Type 


Initiator Receives 


Initiator Sends 


RTS 


DATA 




RTO j 


DATA 




RTWB 


DATA & PRN 


DATA 


RS 


DATA 




WS 


ACK&PRN 


DATA 


WB 


PRN 


DATA or NACK 


WBS 


PRN 


DATA or NACK 
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Transaction Type 


Initiator Receives 


Initiator Sends 


RIO 


DATA 




WIO 


PRN 


DATA 


INT 


PRN or NACK 


DATA or Nothing 
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Access Rights Symbol 


Access Rights Name 


Description 


Data Present? 


W 


Write 


Read and Write 


Yes 


A 


All-Write 


Write-only, must write entire cache line 


Yes (orACK) 


R 


Read 


Read-only 


Yes 


T 


Transient-Read 


Read-only, read can be reordered 


Yes 


i 


Invalid 


No access rights 


Yes or No 



Fig. 10A 



Ownership Status Symbol 


Ownership Status Name 


Description 


Data Present? 


0 


Owner 


Owns cache line 


Yes or No 


N 


Not Owner 


Does not own cache line 


Yes or No 



Fig. 10B 
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Ownership Status 
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W 


N 


A 


N 1 


R 


N 


T 


N 


I 


N 



Fig. 10C 



Transaction Type 


New Owner 


RTS 


Previous Owner 


RTO 


Initiator 


RTWB 


Memory 


RS 


Previous Owner 


ws 


Memory 


WB 


Memory (or Previous Owner) 


WBS 


Memory (or Previous Owner) 
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Fig. 12A 
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Data Out 
A 



Data In Address In Address Out 



Data and Address Queues 
720 



Promise 
Array 
904 



Transitory 
State 

Controller 
902 



Interface Controller 90Q 



Cache 
710 



State Info 
712 



Processing Unit 
702 
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S tateD escrip tlon ■ j 


iWOfh Waiting for WAIT and ACK for local WS. has write accsss and ownership 


[WO Stable state with write access and ownership' " — 


=ROm iWaicing for WAIT and ACK for local WS. has read access and ownership " 


!KUe 


Waiting for DATA for local RTO. has read access and ownership 


jSOde 


Waiting for INV and DATA for local RTO. has read access and ownership 


jROd 


Waiting for INV for local RTO. has read access and ownership ~ " 


jROce 


Waiung for WAIT and DATA for local RTO. has read access and ownership 


iRO 

K-= 


Stable state with read access and ownership ■— 1 


<iue [Waiting For DATA for local kiu. nas no access rights, has ownershin 


jiuae 


waning for INV and DATA for local RTO. has no access rights, has ownership 


irOd 


[Waiting for INV for local RTO. has no access rights, has ownership ~ 


jWNj 


•Able to send DATA/NACK for local WB/WBS. has write access and no ownership 


jWNi 


jAbie to send DATA for local RTWB. write access, no ownership ~ ~ 


jWNh 


[Waiting for ACK for local WS. has write access, no ownership 


:wnc 'Waiting tor WAIT for local RTO. has write access, no ownership 


1 


puioie staLe wiui write access, no ownership (caused by foreign transaction that took ownership, but for which ao 
rapyback has yet been performed) H 


ANi 


jACle to send DATA for local WS after performing write to entire cache line, no ownershiD 


<RNj 


Able to send DATA/NACK for local WB/WBS. has read access and no ownership 


jRNh 


;Waiting ror ACK for local WS. has read access, no ownership 


iKWg jWaidng ror INV for local WS. has read access, no ownership 


l RNe (Waiting for DATA for local RTO. has read access, no ownership ~ " 


ptivae 


jwaitlng tor INV and DATA for local RTO. has read access, no ownershio " 


; KNO (Waiting for INV for local RTO. has read access, no ownership — 1 


iKJNce 


iWauing For WAIT and DATA for local RTO. has read access, no ownership ~ 


iRNcd 


[Waiting for WAIT and INV for local RTO. has read access, no ownership 


[RN 


;Stable state with read access, no ownership — 


jlNk 


iPerrormmg read(s). which may be reordered, for local RTS or RS. no ownership 

jwaitlng for local RTO. RTWB. WS. WB or WBS after receiving an ERR or ERRL. No acc« s rtahr, no nwn^h^ 


m Able to send DATA/NACK for local WB/WBS. has no access riRhts and no ownershin 


}iNh 


IWoiang tor ACK for local WS or for DATA for local RTWB. has no access rights, no ownershia " ' ' 


jlNg 


(Waiting for INV for local WS or for INV for local RTWB, has no access rights, no ownership 


}INe 


[Waiting for DATA for local RTO, has no access rights, no ownership 


ilNde 


jWaiting for INV and DATA for local RTO. has no access rights, no ownershio 


jlNd 


jwaitlng for INV for local RTO. has no access rights, no ownership 


[INce 


IWaitlng for WAIT and DATA for local RTO. has no access rights, no ownership " " 


pNcd 


jWaiting for WAIT and INV for local RTO. has no access rights, no ownership 


jlNa 


iWaiting tor DATA ror local RTS. DATA may grant read access, has no access rights, no ownership 


•IN 


Stable state with no access rights, no ownership 



Action 
Cc^- 


~ i ■ — — . 

Meaning j Comments 




commit tc send an ACK packet as a j 
ccpyback by appending an entry for the 
received foreign packet in a ccpyback list. 
Set copy tag to 1. 


ACK packet may be sent from any state that allows 
copyback packets to be sent. It must be sent within a 
finite time of first entering such a state, regardless of 
what other oackets have been received. 


CI 


Commit to send DATA and/or ACK packets 
for all outstanding copybacks for this cache 
iine. Next, set copy tag to W. Then, perform 
state transition based on current state & 
iocai packet being received. 


If sending copybacks changes the state from a state 
X to a state Y, the local packet being received will be 
received in state Y (and as a result, "the entry for 
state Y in the table must be consulted to determine 
uit: biate iransiaon CaUScO oy receiving the local 
oacket). 


16 

| 
! 


Commit tc send DATA packet for local 
RTWB, WS, WE, or WES transaction. DATA 
oacke* is ssnt in rp^nnncp ?n rp^ciuinn - 

^t—wv^ . , w s_ i 1 1. til 1 COpUl IwCT vU 1 C^Cl V 11 ILj a 

FRlM ngr'<pr fnrfhi^ fnariQsctinn 


DA i A packet may not be sent until a PRN packet is 
received. It must be sent within finite time of 
receiving the PRN packet & having entered a state 
that permits the packet to be sent, regardless of what 
other oackets have been received 


el 


uear outstanding copyback commitments 
for this line by removing them from the 

CCOVback list Do not send DATA nr APk' 

packets for entries that were on the 
copyback list. Next, perform state transition 
based on current state & local packet being 
received. 


j_his action code is used in response to receiving an 
ERR or tRRL packet. If an ERR packet was 
received in place of a PR or PRACK packet, or if an 
ERRL packet was received in piece of a DATAF 
packet, a DATA packet may be sent to the error 
device. 


l\ 


Commit to send a DATA packet as a 
copyback by appending an entry for the 
received foreign packet in the copyback list 
Set cooy taa to 1. 


-/r\i r\ ucLi\ci may ue sent tram any State iTioi allows 
copyback packets to be sent. It must be sent within 
"finite time of first entering such a state, rega r dless of 
what other packets have been received. 


l\ 


Set write taa to I. 




In 


Commit to send (MACK packet far iocai WB 
or WES transaction & set write tag to W. 
NACK packet is sent in response to 
receiving a PRN packet for this transaction 


NACK packet may be sent at any time after receiving 

the PRN T?rkpj It rnn 1 ;? ho cant urithtn -nr-iiTci Hmc t-ir 

u,c 1 iMN |j curve*, it iiiuct sjti sent wiinin unite time OT 
receiving the PRN packet, regardless of what other 
oackets have been received. 


/r 


Commit to send a DATA packet as a 
ccpyback by appending an sntry for the 
received foreign packet in the copyback list. 
If copv tap is W, set coov taa to R. 


DATA packet may be sent from any state that allows 
copyback packets to be sent. It must be sent within 
finite time of first entering such a state, regardless of 
what other packets have been received. ~ | 


is 


bet write tap to R. 


1 


/w 


Commit to send a DATA packei as a 
! copyback by appending an entry for the 

j received foreign packet in the ccpyback list. 

! ' . 
i 


DATA packet may be sent from any state that aliews 
copyback packets to be sent. It must be sent within 
finite time of first entering such a state, regardless of 
what ether packets have been received. 


/y 


j it ccpy tag is k, set copy tag to 1. 


Used to record invalidating transactions while a 
ccpyback for a forelan memon; remaD Is pendino 


>z 


lr write tag is R, set write tag to i. 


Useo to record invalidating transactions while a iocai 
WES transaction is oendino. 
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tero(c + d) 
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Vd) 
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Ve) 
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|f or RTWB (g) 
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lWS(/+ 



[WAIT for WS 

m 



INV for WS 



lACK for WS 



mm. 



\ l-F-l 



[WBAVBS 



ERR (2) 



ERRL for 
I RTS/RS 



IERRL for RTO/ 
IRTWB (2) 



■Write tag W 



jWrite tag R 



[Write tag I 



gBgjSilent Downgrade 
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RTO (1) 




RTO (2) 
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Subsystem 
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ti 



Interface 
148A 
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142AC 
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Data Network 
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gTag 


Description 


gM 


The maximum access right within the node is Write Access 


gs 


The maximum access right within the node is Read Access. No 
client device in the node can have Write Access. 


gi 


The maximum access right within the node is Invalid Access. No 
client device in the node can have Read or Write Access. 



Fig. 21 



Packet 




Address Space 




Type 


Full Name 


Cacheable 


I/O 


Description 


PRT3 


Proxy RTS 


Y 




Request from an interface in a gS or gl node in 
response to an RTS request from another node 


PRTSM 


Proxy RTS Modified 


Y 




Request from an interface in a gM node in 
response to an RTS request from another node 


PRTOM 


Proxy RTO Modified 


Y 




Request from an interface in a gM node in 
response to an RTO request from another node 


PRTO 


Proxy ReadToOwn 


Y 




Request from an interface in response to an RTO 
reqest from another node 


PU 


Proxy Upgrade 


Y 




Request from an interface asking memory to 
supply data for an outstanding RTO 


PDU 


ProxyDataUpgrade 


Y 




Request from an interface asking memory to 
update gTag to gM; interface supplies data for an 
outstanding RTO 


PRSM 


Proxy ReadStream 
Modified 


Y 




Request from an interface in a gM node in 
response to RS request from another node 


PIM 


Proxy In validate 
Modified 


Y 




Request from an interface in a gM node to 
invalidate data in caches and memory 


Pi 


Proxy Invalid ate 


Y 




Request from an interface in a gS or gl node to 
invalidate data in caches and memory 


PMR 


ProxyMemoryRead 


Y 




Request from an interface to memory to read 
coherency state(s) and data or meta-data 


PMW 


ProxyMemoryWrite 


Y 




Request from an interface to memory to write 
coherency state(s) and data or meta-data 



Fig. 22 



Packet 
Type 


Full Name 


Description 


DATAM 


Data-Meta 


Data packet containing data and coherence state information 


DATAN 


Data-NoPull 


Data packet sent in response to PRTSM indicating no PRN will be 
coming 


RE? 


Report 


Report from memory to an interface indicating a transaction to be 
handled by the interface 



Fig. 23 



Subtransaction 


Preexisting 

Global Access State 


New Global Access State 


PRTSM 


Modified 


Shared 


PRTOM 


Modified 


invalid 


PRTO 


Shared, Invalid 


Invalid 


PU 


Shared 


Modified 


PDU 


Shared, Invalid, Modified 


Modified 


PRSM 


Modified 


Unchanged 


PIM 


Modified 


Invalid 


PI 


Shared, Invalid 


Invalid 


PMR 


Shared, Invalid, Modified 


Unchanged 


PMW 


Shared, Invalid, Modified 


Equal to new global access state 
specified in DATAM packet 



Fig. 24 
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Home Node 14QH 




Fig. 26 



Home Node 140H 




Fig. 27 
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830 



^ r 



840 



Data In 



Address In 



Address Out 
A 




Request Agent(s) 
802 



Home Agent(s) 
804 

Global Information 
850 



. Slave Agent(s) 
806 



| Interface 148 

Communications In/Out 



F/g. 29 




Fig. 30 



PRTSM Home Node 140H 




Requesting Node 140R 



Fig. 31 
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Home Node 140H 




Requesting Node 140R 



Fig. 33 




Requesting Node 140R 



Fig. 34 



Response Info 


giag 


Home Memory Subsystem Action 


No 


gM 


BC Mode- Allow owning device to respond. 
PTP Mode- Forward response to owning 
device 


No 


gs 


Send REP packet to interface if write access 
requested 


No 


gi 


Send REP packet to interface 


Yes 


gM 


Respond with copy of the requested coherency 
unit 



Fig. 35 



Response 
Info 


Memory Subsystem's Action 


mN 


Does not respond with copy of 
coherency unit because a cache within 
the node owns the coherency unit 


mR 


Does respond because memory is the 
owner 


mS 


Does respond to requests for shared 
access because memory has shared 
copy and no active device has 
ownership; does not respond to 
requests for write access 


ml 


Does not respond because memory's 
copy is invalid 



Fig. 36 




Fig. 37 



i 



Send PRTOM, PRTSM, 
PIM,or PRSM specifying 
the coherency unit 
500 



Respond = false 
502 



T 



Current record = oldest 
record in OTQ specifying 
the coherency unit 
504 



Yes 



Respond = 

False: Receive data packet 
from active device in 
response to packet sent at 
500. Send received data in 
coherency message 

True: Send data from buffer 
in coherency message 

512 



Current 
record correspond to packet 
sent at 500? 
506 



No 



Fig. 37 A 



Current record = 

RTO: Send data packet using data from 
buffer if respond = true & set respond = 
false 

RS, RTS: Send data packet using data 
from buffer if respond = true 

WB, WBS: Send PRN packet. Set 
respond = true if responsive DATA 
packet received & store received data in 
buffer 

WS, RTWB: If respond = false, send 
PRN & set respond = true & store 
received data in buffer. If respond = true, 
send PRACK or DATAP 

508 



I 



Current record = next eldest record in 
OTQ specifying the coherency unit 
510 



Requesting/Home Node 140H 




Fig. 38 



Requesting/Home Node 14GH 
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Packet 
Type 


Full Name 


Description 


RWB 


Remote WB 


Request sent from an active device in a multi- 
node system to an interface in order to initiate a 
WB transaction 


RWBS 


Remote WBS 


Request sent from an active device in a multi- 
node system to an interface in order to initiate a 
WBS transaction 


RWS 


Remote WS 


Request sent from an active device in a multi- 
node system to an interface in order to initiate a 
WS transaction 



Fig. 39 



Requesting Node 140R 



RWE 



PRTOM 




Data/ 

Acknowledgment 



Home 
RWB 



Slave RTO 





/ Interface >p 




148H J 


pmw/ 






prn/ / 




/ DATAM 


v Mgl / 






Home Node 140H 
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